Tying audio and video watermarks of live and recorded events for simulcasting alternative content to an audio channel or second screen

ABSTRACT

An alternative content system receives a primary content data stream and a secondary content data stream associated with an event. The alternative content system provides an alternative content data stream associated with the event. The alternative content system extracts a primary content identifier from the primary content data stream. The alternative content system identifies an alternative content identifier based on the alternative content data stream. The alternative content system synchronizes the alternative content data stream to the primary content data stream based on the alternative content identifier and the primary content identifier. The alternative content system transmits the synchronized alternative content data stream based on the primary content identifier.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application and claims the benefit ofU.S. patent application Ser. No. 14/220,586 filed Mar. 20, 2014, whichclaims the benefit of U.S. Provisional Patent Application No.61/885,569, filed Oct. 2, 2013, the disclosures of which areincorporated herein by reference in their entireties.

TECHNICAL FIELD

The present invention relates generally to service provider videonetworks, and more particularly, to a method and system forsynchronizing primary video content of live and recorded events withalternative content from a second audio channel or second screen.

BACKGROUND

Television, radio, and other broadcast or recorded media have convertedfrom analog to digital format with respect to recording and playback ofprograms. Digital television and radio are being integrated with theInternet, such that an end user may view live and recorded events fromInternet-ready televisions, desktops, lap tops, tablet computers, mobiledevices, etc. (herein referred to as “second screens”).

There has also been an explosion of social media, such as Facebook,Twitter, etc., that permit users to join networks of social groups.Members of social networks may post text, still images, audio, andvideo, and have other members comment on and provide feedback for theposted items. There are a host of social networking providers that havemarried second screen and social media applications. There are amultitude of applications that marry the second screen and capitalize onsocial media. Such applications include IntoNow, Shazam, GetGlue, Miso,and Zeebox. The trend has been to enable second-screen providers tocreate content specifically for the second screen. The goal of secondscreen providers is to create heightened audience engagement, drivetraffic to an application, and generate advertisement revenue.

There are also applications that enable audience members to discussshows, events, and games (hereinafter “events”). Applications includeTwitter and SportsYapper. There exist applications that permit users tobroadcast events from their mobile devices, including alternative audiocommentary. The alternative audio commentary may include play-by-play,color commentary, etc.

Unfortunately, providers of alternative audio commentary applicationshave had difficulty synchronizing the primary video track of the eventwith the alternative audio commentary track of the event. In certainsituations, an end user of the alternative audio application may receivethe alternative audio track significantly before receiving the primaryvideo track. The end user may hear an alternative audio commentatorannounce that a player has hit a home run up to seconds before seeingthe video feed, ruining the experience of the game. Another problematiceffect encountered in alternative audio applications is known as drift.Drift occurs when there is a noticeable difference in time between whenan end user and when an alternative audio commentator receive video ofthe same event. An alternative audio track received by the end user maystill not be synchronized with the video track received by the end user.

Accordingly, what would be desirable, but has not yet been provided, isa system and method for synchronizing primary video of live and recordedevents with alternative audio commentary from a second audio channel ora second screen.

SUMMARY

The above-described problems are addressed and a technical solution isachieved in the art by providing a method and alternative content systemfor synchronizing primary video of live and recorded events withalternative audio commentary from a second audio channel or a secondscreen. The alternative content system receives a primary content datastream and a secondary content data stream from a content deliverynetwork. Both the primary content data stream and the secondary contentdata stream are associated with an event. The alternative content systemprovides an alternative content data stream corresponding to the event.The alternative content system extracts a primary content identifierfrom the primary content data stream. The alternative content systemidentifies an alternative content identifier based on the alternativecontent data stream. The alternative content system synchronizes thealternative content data stream to the primary content data stream basedon the alternative content identifier and the primary contentidentifier, respectively. The alternative content system transmits thesynchronized alternative content data stream in place of the secondarycontent data stream to an end user system based on the primary contentidentifier.

In an example, the alternative content system transmitting thesynchronized alternative content data stream to the end user systembased on the primary content identifier may comprise the alternativecontent system comparing the primary content identifier to thealternative content identifier. When the primary content identifier andthe alternative content identifier are equivalent, the alternativecontent system permits transmitting the synchronized alternative contentdata stream to the end user system. When the primary content identifierand the alternative content identifier are not equivalent, thealternative content system does not transmit the synchronizedalternative content data stream to the end user system.

In an example, the alternative content system may further transmit theprimary content identifier and the alternative content identifier to theend user system.

In an example, the primary content identifier uniquely identifies aportion of the primary content data stream. The alternative contentidentifier uniquely identifies a portion of the alternative content datastream. The primary content identifier and the alternative contentidentifier may be digital watermarks. In an example, the alternativecontent system may further generate a second alternative contentidentifier corresponding to the primary content identifier, where thealternative content identifier and the second alternative contentidentifier are digital watermarks. The alternative content system mayfurther transmit the alternative content identifier and the secondalternative content identifier to the second system.

In an example, the primary content identifier and the alternativecontent identifier may be digital fingerprints. In one example, thedigital fingerprints or watermarks may be generated internally by thealternative content system or may be generated externally from a serviceprovider or producer.

In an example, the primary content data stream corresponds to one of avideo data stream, an audio data stream, or a metadata streamcorresponding to the video data stream or the audio data stream. In anexample, the alternative content data stream corresponds to one of avideo data stream, an audio data stream, or a metadata streamcorresponding to the video data stream or the audio data stream. In anexample, the secondary content data stream is a primary audio commentarydata stream and the alternative content data stream is an alternativeaudio commentary data stream.

The alternative audio commentary data stream may be a color commentarystream, play-by-play commentary stream, one or more external soundtracks (e.g., of a song, a movie, etc.) one or more foreigntranslations, voice casts (e.g., to audition people to find the bestvoice for an animate or dubbed film or audio book), etc. In one example,the alternative content system may be configured to add or drop variouscombinations of color commentary data streams, play-by-play datastreams, sound tracks, foreign translations. The alternative contentsystem may be configured to synchronize these various combinations withthe primary content data stream.

In an example, the event may be a live event or a recorded event. Theevent may be a sporting event, an entertainment event, a video game, asound track, a voice cast, etc.

The above-described problems are addressed and a technical solution isachieved in the art by providing a method and end user system forsynchronizing primary video of live and recorded events with alternativeaudio commentary from a second audio channel or second screen. The enduser system receives a direct primary content data stream and asecondary content data stream from a content delivery network. Both thedirect primary content data stream and the secondary content data streamare associated with an event. The direct primary content data streamcomprises a direct primary content identifier. The end user systemreceives from an alternative content system, an alternative content datastream corresponding to the event. The alternative content data streamcomprises an alternative content identifier and an indirect primarycontent identifier. The indirect primary content identifier isassociated with an indirect primary content data stream associated withthe event. The alternative content data stream is synchronized to theindirect primary content data stream. The end user system extracts thedirect primary content identifier from the direct primary content datastream. The end user system extracts the alternative content identifierand the indirect primary content identifier from the alternative contentdata stream. The end user system synchronizes the indirect primarycontent data stream with the alternative content data stream based onthe direct primary content identifier, the indirect primary contentidentifier, and the alternative content identifier. The end user systemreplaces the secondary content data stream with the synchronizedalternative content data stream. The end user system transmits thesynchronized direct primary content data stream and the synchronizedalternative content data stream to one or more devices associated withan end user.

To permit a second alternative commentator to provide commentary inaddition to a first commentator, the end user system receives a secondalternative content data stream corresponding to the event. The end usersystem identifies a second alternative content identifier based on thesecond alternative content data stream. The end user system synchronizesthe second alternative content data stream to the primary content datastream based on the second alternative content identifier and the directprimary content identifier, respectively. The end user system transmitsthe synchronized second alternative content data stream to the one ormore devices associated with the end user. In one example, the one ormore devices may be a microphone, a head set, speakers, a storagesystem, etc. The one or more devices may include a storage system forstoring the second alternative content data stream and the primarycontent data stream either as separate tracks or in combination.

In an example, the direct primary content identifier uniquely identifiesa portion of the primary content data stream. The indirect primarycontent identifier uniquely identifies a portion of the indirect primarycontent data stream. The alternative content identifier uniquelyidentifies a portion of the alternative content data stream. In anexample, the direct primary content identifier, the indirect primarycontent identifier, and the alternative content identifier are digitalwatermarks or digital fingerprints.

In an example, the direct primary content data stream, indirect primarycontent data stream, or the alternative content data stream correspondto one of a video data stream, an audio data stream, or a metadatastream corresponding to the video data stream or the audio data stream.

In an example, the alternative content data stream may be a secondalternative audio commentary stream. The second alternative audiocommentary stream may be a color commentary data stream, a play-by-playcommentary stream, one or more external sound tracks, one or moreforeign translations, etc. In one example, the end user system may beconfigured to add or drop various combinations of color commentary datastreams, play-by-play data streams, and sound tracks. The end usersystem may be configured to synchronize these various combinations withthe primary content data stream. In another example, output stream(s)from an end user system may serve as input streams to anotheralternative content system, serve as primary streams to anotheralternative content system or end user system, and/or be stored on aserver. In an example, the event may be a live event or a recordedevent. The event may be a sporting event, an entertainment event, avideo game, a sound track, a voice cast, etc.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be more readily understood from the detaileddescription of exemplary embodiments presented below considered inconjunction with the attached drawings, of which:

FIG. 1A is a block diagram of one embodiment of a system forsynchronizing primary video of live and recorded events with alternativecontent from a second audio channel or second screen.

FIG. 1B is a block diagram of another embodiment of a system forsynchronizing primary video of live and recorded events with alternativecontent from a second audio channel or second screen.

FIG. 2A is a block diagram of one embodiment of an alternative contentsystem employing digital fingerprints as identifiers.

FIG. 2B is a block diagram of one embodiment of an alternative contentsystem employing digital watermarks as identifiers.

FIG. 3A is a block diagram of one embodiment of an end user systememploying digital fingerprints as identifiers.

FIG. 3B is a block diagram of one embodiment of an end user systememploying digital watermarks as identifiers.

FIG. 4 is a flow diagram illustrating an example of a method forsynchronizing a primary video data stream of live and recorded eventswith an alternative content data stream from the perspective of thealternative content system of FIGS. 1A and 1B.

FIG. 5 is a flow diagram illustrating an example of a method forsynchronizing a primary video data stream of live and recorded eventswith an alternative content data stream from the perspective of the enduser system of FIGS. 1A and 1B.

FIG. 6 illustrates a diagrammatic representation of a machine in theexemplary form of a computer system within which a set of instructions,for causing the machine to perform any one or more of the methodologiesdiscussed herein, may be executed.

It is to be understood that the attached drawings are for purposes ofillustrating the concepts of the invention and may not be to scale.

DETAILED DESCRIPTION

FIG. 1A is a block diagram of one embodiment of a system 100 forsynchronizing primary video of live and recorded events with alternativeaudio commentary from a second audio channel or a second screen. Thesystem 100 may include a content delivery network 105 (CDN). The CDN 105may be configured to deliver a primary content data stream comprising aprimary video data stream 110 of a live or recorded video event and/oran associated primary audio data stream 115 of the live or recodedevent. The CDN 105 may be further configured to deliver a secondarycontent data stream 120 and an optional metadata stream 125. The primaryaudio data stream 115 may be a recording of sound associated with theprimary video data stream 110 of the live or recoded event. Thesecondary content data stream 120 may be a recording of sound associatedwith, in one example, a play-by-play announcer that comments on the liveor recoded event. In one example, the optional metadata stream 125 mayprovide an out-of-band primary content identifier data stream 130 ofperiodically transmitted identifiers (e.g., digital fingerprints) thatuniquely identify each segment of the primary video data stream 110and/or primary audio data stream 115. In another example, the primarycontent identifier data stream 130 may be included in-band within theprimary video data stream 110 and/or primary audio data stream 115(e.g., digital watermarks).

In one example, the primary content identifier data stream 130 maycomprise digital fingerprints of each segment of the primary video datastream 110 and/or primary audio data stream 115. A digital fingerprint,as is known in the art, may summarize the values of each of the videopixels of a set of video frames associated with the primary video datastream 110 or may summarize the values of each segment of the primaryaudio data stream 115. In another example, there is no out-of-bandprimary content identifier data stream 130. Instead, each segment of theprimary video data stream 110 and/or primary audio data stream 115 mayhave an embedded (in-band) digital watermark. A digital watermark, as isknown in the art, may be pixels of a small image that may be inserted,unnoticeable to an end user (e.g., 165 a), into the pixels of each frameof the primary video data stream 110 or into the primary audio datastream 115.

The content delivery network server 105 may be configured to deliver theprimary video data stream 110, the primary audio data stream 115, thesecondary content data stream 120, and the optional metadata stream 125to one or more alternative content systems 135 a-135 n and one or moreend user systems 140 a-140 n over a network 145 which may be, but is notlimited to, the Internet. Each of the alternative content systems 135a-135 n may be configured to substitute an alternative content datastream 150 for the secondary content data stream 120 and deliver thealternative content data stream 150 to the one or more end user systems140 a-140 n over the network 145. The alternative content data stream150 may be at least one of an audio commentary data stream, a videocommentary data stream, or a text data stream. The alternative audiocommentary data stream may be a color commentary stream, play-by-playcommentary stream, one or more external sound tracks (e.g., of a song, amovie, etc.), one or more foreign translations, a voice cast, or otheralternative content data stream.

Each of the alternative content systems 135 a-135 n may be configured toreceive the primary content data stream (e.g., the primary video datastream 110 and/or the primary audio data stream 115), the secondarycontent data stream 120, and the optional metadata stream 125 from theCDN 105. Each of the alternative content systems 135 a-135 n may beconfigured to employ processing logic 153 to synchronize the alternativecontent data stream 150 with the primary video data stream 110 and/orthe primary audio data stream 115. Each of the alternative contentsystems 135 a-135 n may be configured to employ processing logic 153 toextract primary content identifiers 155 (e.g., digital fingerprints,watermarks, etc.) from the primary content identifier data stream 130,extract alternative content identifiers 160 from the alternative contentdata stream 150, and synchronize the primary video data stream 110and/or the primary audio data stream 115 to the alternative content datastream 150 based on the primary content identifiers 155 and thealternative content identifiers 160 using means known in the art. Thealternative content systems 135 a-135 n may be configured to transmitthe synchronized alternative content data stream 150, the primarycontent identifiers 155, and the alternative content identifiers 160 toeach of the one or more end user systems 140 a-140 n.

Each of the alternative content systems 135 a-135 n may be furtherconfigured to permit one or more corresponding end users 165 a-165 nassociated with the one or more end user systems 140 a-140 n to registerwith one or more alternative content systems 135 a-135 n to receive thesynchronized alternative content data stream 150. An alternative contentsystem (e.g., 135 a) may be configured to provide an event schedule thatincludes information about one or more events that may be transmittedand may be configured to provide an alternative content data stream 150.The schedule may be searchable and browseable by event type (e.g.,sports, concerts, etc.), by performer (e.g., teams, orchestras, artists,etc.), by event time, and may include a list of currently activealternative content systems (e.g., 135 a-135 d).

An alternative content system (e.g., 135 a) may be configured to displayalternative content identifiers 160 associated with a commentator (e.g.,170 a) associated with the alternative content system (e.g., 135 a) anda list of end users 165 a-165 n that are currently logged into a socialnetwork associated with the commentator (e.g., 170 a). The alternativecontent system (e.g., 135 a) may be configured to permit the commentator(e.g., 170 a) to invite the currently logged-in users (not shown) to theevent that the commentator (e.g., 170 a) may be announcing. Thealternative content system (e.g., 135 a) may be configured to permit thecommentator (e.g., 170 a) to sign-up to announce selected events. Thealternative content system (e.g., 135 a) may be configured to pushnotifications of availability of a commentator (e.g., 170 a) forannouncing selected events to users of social networks (e.g., Facebook,Twitter, LinkedIn, Google+, etc.) that are currently logged into the enduser systems 140 a-140 n. The alternative content system (e.g., 135 a)may be configured to provide statistics for an event that thecommentator (e.g., 170 a) is currently announcing. The alternativecontent system (e.g., 135 a) may be configured to permit one or moreadditional commentators (e.g., 170 b-170 f) to join in to announce anevent. The commentator (e.g., 170 a) associated with the alternativecontent system (e.g., 135 a) may, for example, provide “play-by-play”commentary while another commentator (e.g., 170 b) may provide “colorcommentary” for the same event. The alternative content system (e.g.,135 a) may be configured to provide the commentator (e.g. 170 a) withone or more audio/video streaming devices 180 a-180 n. The streamingdevices 180 a-180 n may comprise a display for receiving and displayingthe primary video data stream 110 and a microphone or head set forreceiving the primary audio data stream 115 and for generating thealternative content data stream 150.

Each of the one or more end user systems 140 a-140 n may be configuredto receive the primary content data stream (e.g., the primary video datastream 110 and/or the primary audio data stream 115), the secondarycontent data stream 120, and the optional metadata stream 125 from theCDN 105. Each of the end user systems 140 a-140 n may be furtherconfigured to receive the synchronized alternative content data stream150, the primary content identifiers 155, and the alternative contentidentifiers 160 from the alternative content system (e.g., 135 a).Processing logic 157 of an end user system (e.g., 140 a) may receive orextract in-band or out-of-band second primary content identifiers 183received from the CDN 105, receive or extract the in-band or out-of-bandprimary content identifiers 155 received from the alternative contentsystem (e.g., 135 a) and originating from the CDN 105, and receive orextract the alternative content identifiers 160 from the synchronizedalternative content data stream 150 of the secondary commentary system(e.g., 135 a). Each of the end user systems 140 a-140 n may beconfigured to employ the processing logic 157 to further synchronize thesynchronized alternative content data stream 150 with the primary videodata stream 110 and/or primary audio data stream 115 based on theprimary content identifiers 155, the second primary content identifiers183, and the alternative content identifiers 160 by means known in theart. The end user system (e.g., 140 a) may be configured to employ theprocessing logic 157 to combine the further synchronized primary videodata stream 110 and/or primary audio data stream 115 with the furthersynchronized alternative content data stream 150 in place of thesecondary content data stream 120 to produce a combined signal stream185. The combined signal stream 185 may be streamed to one or moreaudio/video streaming devices 190 a-190 n to an end user (e.g., 165 a).The streaming devices 190 a-190 n may comprise a display for receivingand displaying the primary video data stream 110 and a microphone orhead set for receiving the primary audio data stream 115 and thealternative content data stream 150.

Each of the alternative content systems 135 a-135 n may be furtherconfigured to permit the end users 165 a-165 n associated with the oneor more end user systems 140 a-140 n to register with one or morealternative content systems 135 a-135 n to receive the synchronizedalternative content data stream 150. An end user system (e.g., 140 a)may be configured to provide an end user (e.g., 165 a) with an eventschedule that comprises information about one or more events that may bereceived from the CDN 105. The schedule may be searchable and browseableby event type (e.g., sports, concerts, etc.), by performer (e.g., teams,orchestras, artists), by event time, and may include a list of currentlyactive alternative content systems (e.g., 135 a-135 x). The end usersystem (e.g., 140 a) may be configured to display to an end user (e.g.,165 a) a list of end users (e.g., 165 a-165 x) that are currently loggedinto a social network associated with the end user (e.g., 165 a). Theend user system (e.g., 140 a) may be configured to permit the end user(e.g., 165 a) to invite the currently logged in end users (e.g., 165a-165 x) to receive a synchronized alternative content data stream 150of a selected alternative content system (e.g., 135 a). The end usersystem (e.g., 140 a) may be configured to permit the end user (e.g., 165a) to receive push notifications of the availability of alternativecontent systems 135 a-135 n for selected and upcoming events and toother users of a social associated with the end users (e.g., 165 a-165n) (e.g., Facebook, Twitter, LinkedIn, Google+, etc.) that are currentlylogged into the end user systems 140 a-140 n. An end user system (e.g.,140 a) may be configured to permit the end user 165 a to message acommentator (e.g., 170 a) of an alternative content systems (e.g., 135a) and other end users (e.g., 165 a-165 n) in a selected social networkof the end user (e.g., 165 a). The end user system (e.g., 140 a) may beconfigured to permit the end users (e.g., 165 a-165 n) to microblogabout the events that they may be currently listening to and/or viewing.Others of the end users (e.g., 165 a-165 n) that may be listening to thesame event may limit receipt of such microblogs (e.g., exclude end users165 b-165 d that are not in their social network).

The system of FIG. 1A may be subject to numerous variations as shown inFIG. 1B. FIG. 1B is a block diagram of another embodiment of a systemfor synchronizing primary video of live and recorded events withalternative audio commentary from a second audio channel or secondscreen. The system 100 may include substantially the same elementshaving substantially the same functionality as elements designated withlike numerals of FIG. 1 except for the addition of an identifier server175 and a storage server 195. The identifier server 175 may beconfigured to provide the identifiers comprising fingerprints and/orwatermarks employed by any of the signals requiring synchronizationwithin the alternative content systems 135 a-135 n and/or the end usersystems 140 a-140 n. The storage server 195 or the CDN 105 may beconfigured to store and any combination of the signals 110, 115, 120,125, 130 emanating from the CDN 105 comprising content and/or identifierstreams, any of the signals emanating from the alternative contentsystems 135 a-135 n (150, 155, 160) and/or the combined signal stream185 emanating from the end user systems 140 a-140 n. Any combination ofthe stored signals 110, 115, 120, 125, 130, 150, 155, 160, 185 may beemployed as inputs for any other of the alternative content systems 135a-135 n and/or the end user systems 140 a-140 n. The combinations of thestored signals 110, 115, 130, 125, 130, 150, 155, 160, 185 may be storedin the storage server 195 or the CDN 105 either as separate tracks or incombination.

An end user system (e.g., 140 a) may multiplex and synchronize anycombination of primary content data streams and alternative content datastreams from one or more of the alternative content systems 135 a-135 nor other end user systems 140 b-140 n. The end user system (e.g., 140 a)may provide its combined signal stream 185 as a primary content datastream or as an alternative content data stream to another of thealternative content systems 135 a-135 n or other end user systems 140b-140 n.

An alternative content system (e.g., 135 a) may multiplex andsynchronize any combination of primary content data streams andalternative content data streams from one or more of other alternativecontent systems 135 b-135 n or the end user systems 140 a-140 n. Thealternative content system (e.g., 135 a) may provide its output signalstreams 150, 155, 160 as a primary content data streams or as analternative content data streams to another of the other alternativecontent systems 135 b-135 n or the end user systems 140 a-140 n.

In one example, the alternative content system (e.g., 135 a) and/or theend user system (e.g., 140 a) may be configured to add or drop variouscombinations of color commentary data streams, play-by-play datastreams, sound tracks, foreign translations, voice casts, and otherprimary and/or alternative content. The alternative content system(e.g., 135 a) and/or the end user system (e.g., 140 a) may be configuredto synchronize these various combinations of data streams with theprimary content data streams.

In an example, the alternative content data stream 150, 155, 160 may besecond alternative audio commentary data streams. The second alternativeaudio commentary streams may be color commentary data streams,play-by-play commentary streams, one or more external sound tracks, oneor more foreign translations, voice casts, etc. In one example, the enduser system (e.g., 135 a) may be configured to add or drop variouscombinations of color commentary data streams, play-by-play datastreams, sound tracks, or other primary content and/or alternativecontent. The end user system (e.g., 135 a) may be configured tosynchronize these various combinations of data streams with primarycontent streams (e.g., video, audio, data, etc.). In another example,the combined output stream(s) 185 from an end user system (e.g., 135 a)may serve as input streams to another alternative content system (e.g.,135 b), serve as primary content streams to another alternative contentsystem (e.g., 135 n) or end user system (140 n), and/or be stored on thestorage server 195 or the CDN 105. In an example, the event may be alive event or a recorded event. The event may be a sporting event, anentertainment event, a video game, a sound track, a voice cast, etc.

FIG. 2A is a block diagram 200A of one embodiment of an alternativecontent system (e.g., 135 a) employing digital fingerprints asidentifiers. The alternative content system (e.g., 135 a) may comprisememory 205 and a processing device 210 coupled to the memory 205. Theprocessing device 210 may retrieve from the memory 205 instructionscomprising operations to be executed by processing logic 215 of theprocessing device 210. The processing logic 215 may comprise summarizerlogic 220, synchronizer logic 225, network logic 230, and streaminglogic 235. The network logic 230 may be configured to receive theprimary content data stream (e.g., the primary video data stream 110and/or the primary audio data stream 115), the secondary content datastream 120, and an optional metadata stream 125 (including the primarycontent identifier data stream 130) over a network 145 from the CDN 105.The alternative content system (e.g., 135 a) may further comprise aplurality of streaming devices 180 a-180 n that may comprise a videodisplay, an audio receiver, and an audio transmitter. The streaminglogic 235 may provide an alternative content data stream 150 whilepermitting the commentator (e.g., 170 a) to view the primary video datastream 110 and hear the primary audio data stream 115.

In one example, summarizer logic 220 of the alternative content system(e.g., 135 a) may create a plurality of primary content digitalfingerprints 250 based on summaries of segments of the primary videodata stream 110 and/or primary audio data stream 115. Summarizer logic220 of the alternative content system (e.g., 135 a) may create aplurality of alternative content digital fingerprints 255 associatedwith the alternative content data stream 150. Synchronizer logic 225 ofthe alternative content system (e.g., 135 a) may synchronize the primaryvideo data stream 110 and/or primary audio data stream 115 to thealternative content data stream 150 based on the plurality of primarycontent digital fingerprints 250 and the plurality of alternativecontent digital fingerprints 255 by means known in the art. Networklogic 230 of the secondary commentary system (e.g., 135 a) may beconfigured to transmit the synchronized alternative content data stream150 to the end user systems 140 a-140 n. Network logic 230 may befurther configured to transmit the plurality of primary content digitalfingerprints 250 and the plurality of alternative content digitalfingerprints 255 over the network 145 to each of the end user systems140 a-140 n.

FIG. 2B is a block diagram 200B of one embodiment of an alternativecontent system (e.g., 135 a) employing digital watermarks asidentifiers. The alternative content system (e.g., 135 a) may comprisememory 205 and a processing device 210 coupled to the memory 205. Theprocessing device 210 may retrieve from the memory 205 instructionscomprising operation to be executed by processing logic 215 of theprocessing device 210. Processing logic 215 may comprise extractor logic220, synchronizer logic 225, injector logic 227, network logic 230, andstreaming logic 235. The network logic 230 may receive the primarycontent data stream (e.g., the primary video data stream 110 and/or theprimary audio data stream 115), the secondary content data stream 120,and an optional metadata stream 125 (including the primary contentidentifier data stream 130) over a network 145 from the CDN 105. Thealternative content system (e.g., 135 a) may further comprise aplurality of streaming devices 180 a-180 n that may comprise a videodisplay, an audio receiver, and an audio transmitter to permit acommentator (e.g., 170 a). The streaming logic 235 provides analternative content data stream 150 while permitting the commentator(e.g., 170 a) to view the primary video data stream 110 and hear theprimary audio data stream 115.

In one example, extractor logic 220 of the alternative content system(e.g., 135 a) may extract a plurality of primary content digitalwatermarks 260 from the primary video data stream 110 and/or primaryaudio data stream 115 that was injected into the primary video datastream 110 and/or primary audio data stream 115 in the CDN 105. Injectorlogic 227 in the alternative content system (e.g., 135 a) may inject aplurality of alternative content digital watermarks 265 into thealternative content data stream 150 and may be associated with thealternative content data stream 150. Synchronizer logic 225 in thealternative content system (e.g., 135 a) may synchronize the primaryvideo data stream 110 and/or primary audio data stream 115 to thealternative content data stream 150 based on the plurality of primarycontent digital watermarks 260 and the injected plurality of alternativecontent digital watermarks 265 by means known in the art. Network logic230 of the secondary commentary system (e.g., 135 a) may be configuredto transmit the synchronized alternative content data stream 150 to theend user systems 140 a-140 n. Network logic 230 may be furtherconfigured to transmit the plurality of primary content digitalwatermarks 260 and the plurality of alternative content digitalwatermarks 265 over the network 145 to each of the one or more end usersystems 140 a-140 n.

FIG. 3A is a block diagram 300A of one embodiment of an end user system(e.g., 140 a) employing digital fingerprints as identifiers. The enduser system (e.g., 140 a) may comprise memory 305 and a processingdevice 310 coupled to the memory 305. The processing device 310 mayretrieve from the memory 305 instructions comprising operation to beexecuted by processing logic 315 of the processing device 310. Theprocessing logic 315 may comprise summarizer logic 320, synchronizerlogic 325, combiner logic 330, streaming logic 335, and network logic340. The network logic 340 may be configured to receive the primarycontent data stream (e.g., the primary video data stream 110 and/or theprimary audio data stream 115), the secondary content data stream 120,and the optional metadata stream 125 over the network 145 from the CDN105. The end user system (e.g., 140 a) may be further configured toreceive the alternative audio data stream 150, the plurality of primarydigital fingerprints 250, and the plurality of alternative contentdigital fingerprints 255 from the alternative content system (e.g., 135a). The end user system (e.g., 140 a) may further comprise a pluralityof streaming devices 190 a-190 n that may comprise a video display, anaudio receiver, and an audio transmitter to permit an end user (e.g.,165 a) to view and hear, respectively, the primary video data stream 110synchronized to the alternative content data stream 150 streamed by thestreaming logic 335.

In one example, summarizer logic 320 of the end user system (e.g., 140a) may extract a second plurality of primary content digitalfingerprints 350 based on summaries of segments of the primary videodata stream 110 and/or primary audio data stream 115 received from theCDN 105. Summarizer logic 320 may receive or extract the plurality ofalternative content digital fingerprints 255 associated with thealternative content data stream 150. Summarizer logic may furtherreceive or extract the plurality of primary digital fingerprints 250associated with the primary video data stream 110 and/or primary audiodata stream 115 received from the alternative content system (e.g., 135a). Synchronizer logic 325 of the end user system (e.g., 140 a) maysynchronize the primary video data stream 110 and/or primary audio datastream 115 received from the CDN 105 to the alternative content datastream 150 based on the plurality of primary digital fingerprints 250,the plurality of alternative content digital fingerprints 255, and thesecond plurality of primary digital fingerprints 350 by means known inthe art.

Combiner logic 330 in the end user system (e.g., 140 a) may beconfigured to combine the further synchronized primary video data stream110 and/or primary audio data stream 115 with the further synchronizedalternative content data stream 150 in place of the secondary contentdata stream 120 to produce a total signal stream 345. The streaminglogic 335 may be configured to stream the total signal stream 345 to thedisplay for the primary video data stream 110 and a microphone or headset for the alternative content data stream 150 and the primary audiodata stream 115 for viewing and listening, respectively, by the end user(e.g., 165 a).

FIG. 3B is a block diagram 300B of one embodiment of an end user system(e.g., 140 a) employing digital watermarks as identifiers. The end usersystem (e.g., 140 a) may comprise memory 305 and a processing device 310coupled to the memory 305. The processing device 310 may retrieve fromthe memory 305 instructions comprising operation to be executed byprocessing logic 315 of the processing device 310. The processing logic315 comprises extractor logic 320, synchronizer logic 325, combinerlogic 330, streaming logic 335, and network logic 340. The network logic340 may receive the primary content data stream (e.g., the primary videodata stream 110 and/or the primary audio data stream 115), the secondarycontent data stream 120, and the optional metadata stream 125 (includingthe primary content identifier data stream 130) over a network 145 fromthe CDN 105. The network logic 340 may be further configured to receivethe alternative content data stream 150, a plurality of primary contentdigital watermarks 260, and the plurality of alternative content digitalwatermarks 265 from the alternative content system (e.g., 135 a). Theend user system (e.g., 140 a) may further comprise a plurality ofstreaming devices 190 a-190 n that may comprise a video display, anaudio receiver, and an audio transmitter to permit an end user (e.g.,165 a) to view and hear, respectively, the primary video data stream 110synchronized to the alternative content data stream 150 streamed by thestreaming logic 335.

In one example, extractor logic 320 of the end user system (e.g., 140 a)may extract a second plurality of primary content digital watermarks 350based on summaries of segments of the primary video data stream 110and/or primary audio data stream 115 received from the CDN 105.Extractor logic 320 may receive or extract the plurality of alternativecontent digital watermarks 265 associated with the alternative contentdata stream 150. Extractor logic may further receive or extract theplurality of primary content digital watermarks 260 associated with theprimary video data stream 110 and/or primary audio data stream 115received from the alternative content system (e.g., 135 a). Synchronizerlogic 325 of the end user system (e.g., 140 a) may synchronize theprimary video data stream 110 and/or primary audio data stream 115received from the CDN 105 to the alternative content data stream 150based on the plurality of primary content digital watermarks 260, theplurality of alternative content digital watermarks 265, and the secondplurality of primary content digital watermarks 350 by means known inthe art.

Combiner logic 330 in the end user system (e.g., 140 a) may beconfigured to combine the further synchronized primary video data stream110 and/or primary audio data stream 115 with the further synchronizedalternative content data stream 150 in place of the secondary contentdata stream 120 to produce a total signal stream 345. The streaminglogic 335 may be configured to stream the total signal stream 345 to thedisplay for the primary video data stream 110 and a microphone or headset for the alternative audio data stream 150 and the primary audio datastream 115 for viewing and listening, respectively, by the end user(e.g., 165 a).

FIG. 4 is a flow diagram illustrating an example of a method 400 forsynchronizing a primary video data stream 110 of live and recordedevents with an alternative content data stream 150 from the perspectiveof an alternative content system (e.g., 135 a) of FIGS. 1A and 1B. Themethod 400 may be performed by a computer system 600 of FIG. 6 and maycomprise hardware (e.g., circuitry, dedicated logic, programmable logic,microcode, etc.), software (e.g., instructions run on a processingdevice), or a combination thereof. In one example, the method 400 isperformed by processing logic 215 of the alternative content system(e.g., 135 a) of FIGS. 1A, 1B, 2A, and 2B.

In one embodiment, method 400 begins when, at block 405, the processinglogic 215 receives a primary content data stream (e.g., the primaryvideo data stream 110/primary audio data stream 115) and a secondarycontent data stream 120 from a content delivery network (CDN) 105. Theprimary video data stream 110/primary audio data stream 115 and thesecondary content data stream 120 are both associated with an event. Inan example, the event may be a live event or a recorded event. In anexample, the event may be a sporting event, an entertainment event, or avideo game, a sound track, a voice cast, (e.g., of a song, a movie,etc.), etc. In an example, the primary video data stream 110/primaryaudio data stream 115 may corresponds to one of a video data stream, anaudio data stream, or a metadata stream corresponding to the video datastream or the audio data stream.

At block 410, the processing logic 215 provides an alternative contentdata stream 150 corresponding to the event. The alternative content datastream 150 corresponds to one of a video data stream, an audio datastream, or a metadata stream. In one example, the alternative contentdata stream 150 may be a color commentary stream. In another example,the alternative content data stream 150 may be a play-by-play commentarystream. In another example, the alternative content data stream 150 maybe sound tracks (e.g., of a song, a movie, etc.), foreign translations,voice casts, etc.

At block 415, the processing logic 215 extracts a primary contentidentifier 155 from the primary content data stream (e.g., the primaryvideo data stream 110/primary audio data stream 115). At block 420, theprocessing logic 215 identifies or generates an alternative contentidentifier 160 based on the alternative content data stream 150. Theprimary content identifier 155 uniquely identifies a portion of theprimary content data stream (e.g., the primary video data stream110/primary audio data stream 115). The alternative content identifier160 uniquely identifies a portion of the alternative content data stream150. In one example, the primary content identifier 155 and thealternative content identifier 155 may be digital watermarks. In anotherexample, the primary content identifier 155 and the alternative contentidentifier 155 may be digital fingerprints.

At block 425, the processing logic 215 synchronizes the alternativecontent data stream 150 to the primary content data stream (e.g., theprimary video data stream 110/primary audio data stream 115) based onthe alternative content identifier 160 and the primary contentidentifier 155, respectively. At block 430, the processing logic 215transmits the synchronized alternative content data stream 150 in placeof the secondary content data stream 120 to an end user system (e.g. 140a) based on the primary content identifier 155. The processing logic 215transmits the synchronized alternative content data stream 150 to theend user system (e.g. 140 a) based on the primary content identifier 155by comparing the primary content identifier 155 to the alternativecontent identifier 160. When the primary content identifier 155 and thealternative content identifier 160 are equivalent, the processing logic215 permits the transmission of the synchronized alternative contentdata stream 150 to the end user system (e.g. 140 a). When the primarycontent identifier 155 and the alternative content identifier 160 arenot equivalent, processing logic 215 inhibits the transmission of thesynchronized alternative content data stream 150 to the end user system(e.g., 140 a). In another example, the processing logic 415 may furthertransmit the primary content identifier 155 and the alternative contentidentifier 160 to the end user system (e.g., 140 a).

In an example, when the primary content identifier 155 and thealternative content identifier 160 are digital fingerprints, theprocessing logic may identify (e.g., generate or inject into the primaryvideo data stream 110/primary audio data stream 115) a third identifier405 corresponding to the primary content identifier 155, where the thirdidentifier is a digital watermark and further transmit the alternativecontent identifier 160 and the third identifier 405 to the end usersystem (e.g., 140 a).

FIG. 5 is a flow diagram illustrating an example of a method 500 forsynchronizing a primary video data stream 110 of live and recordedevents with an alternative content data stream 150 from the perspectiveof an end user system (e.g., 140 a) of FIGS. 1A and 1B. The method 500may be performed by a computer system 600 of FIG. 6 and may comprisehardware (e.g., circuitry, dedicated logic, programmable logic,microcode, etc.), software (e.g., instructions run on a processingdevice), or a combination thereof. In one example, the method 500 isperformed by processing logic 315 of the end user system (e.g., 140 a)of by processing logic 215 of the alternative content system (e.g., 135a) of FIGS. 1A, 1B, 3A, and 3B.

In one embodiment, method 500 begins when, at block 505, the processinglogic 315 receives a primary content data stream (e.g., the primaryvideo data stream 110/primary audio data stream 115) and a secondarycontent data stream 120 from a content delivery network (CDN) 105. Theprimary video data stream 110/primary audio data stream 115 may eachassociated with an event. The event may be a live event or a recordedevent. The event may be a sporting event, an entertainment event, avideo game, sound tracks (e.g., of a song, a movie, etc.), voice casts,etc. The primary video data stream 110/primary audio data stream 115includes a direct primary content identifier 155. The direct primarycontent identifier 155 uniquely identifies a portion of the primaryvideo data stream 110/primary audio data stream 115 received directlyfrom the CDN 105.

At block 510, the processing logic 315 receives from an alternativecontent system (e.g., 135 a) an alternative content data stream 150corresponding to the event. The alternative content data stream 150includes an alternative content identifier 160 and an indirect primarycontent identifier 180. The alternative content identifier 160 uniquelyidentifies a portion of the alternative content data stream 150. Theindirect primary content identifier 180 may be associated with theprimary video data stream 110/primary audio data stream 115 associatedwith the event and received indirectly from the CDN 105 through thealternative content system (e.g., 135 a). The alternative content datastream 150 may be synchronized to the indirectly received primary videodata stream 110/primary audio data stream 115.

In an example, the direct primary content identifier 155, the indirectprimary content identifier 180, and the alternative content identifier160 may be digital watermarks or digital fingerprints.

In an example, the primary video data stream 110/primary audio datastream 115 may correspond to one of a video data stream an audio datastream, or metadata stream. The alternative content data stream 150 maycorrespond to one of a video data stream, an audio data stream, or ametadata stream corresponding to the video data stream or the audio datastream.

In an example, the alternative content data stream 150 may be a secondaudio commentary stream. The second audio commentary stream may be acolor commentary stream or a play-by-play commentary stream, soundtracks (e.g., of a song, a movie, etc.), foreign translations, voicecasts, etc.

At block 515, the processing logic 315 extracts the direct primarycontent identifier 155 from the primary content data stream (e.g., theprimary video data stream 110/primary audio data stream 115). Theprocessing logic 515 further extracts or receives the alternativecontent identifier 160 and extracts or receives the indirect primarycontent identifier 180 from the alternative content data stream 150.

At block 520, the processing logic 315 synchronizes primary content datastream (e.g., the primary video data stream 110/primary audio datastream 115) with the alternative content data stream 150 based on thedirect primary content identifier 155, the indirect primary contentidentifier 180, and the alternative content identifier 160. At block525, the processing logic 315 replaces the secondary content data stream120 with the synchronized alternative content data stream 150.

At block 530, the processing logic 315 transmits the synchronizedprimary content data stream (e.g., the primary video data stream110/primary audio data stream 115) and the synchronized alternativecontent data stream 150 to one or more audio/video streaming devices 190a-190 n and/or a storage server 195 associated with the end user (e.g.,165 a).

In an example, to permit a second commentator (not shown) to providecommentary (e.g., color commentary) along with a first commentator(e.g., play-by-play commentary), the processing logic may receive asecond alternative content data stream (not shown) corresponding to theevent. The processing logic 315 may generate a second alternativecontent identifier based on the second alternative content data stream.The processing logic 315 may synchronize the second alternative contentdata stream to the primary content data stream (e.g., the primary videodata stream 110/primary audio data stream 115) based on the secondalternative content identifier and the direct primary content identifier155, respectively. The processing logic 315 may transmit thesynchronized second alternative content data stream to the one or morereceiving one or more audio/video streaming devices 190 a-190 nassociated with the end user (e.g., 165 a).

FIG. 6 illustrates a diagrammatic representation of a machine in theexample form of a computer system 400 within which a set ofinstructions, for causing the machine to perform any one or more of themethodologies discussed herein, may be executed. In some examples, themachine may be connected (e.g., networked) to other machines in a LAN,an intranet, an extranet, or the Internet. The machine may operate inthe capacity of a server machine in client-server network environment.The machine may be a personal computer (PC), a set-top box (STB), aserver, a network router, switch or bridge, or any machine capable ofexecuting a set of instructions (sequential or otherwise) that specifyactions to be taken by that machine. Further, while only a singlemachine is illustrated, the term “machine” shall also be taken toinclude any collection of machines that individually or jointly executea set (or multiple sets) of instructions to perform any one or more ofthe methodologies discussed herein.

The example computer system 600 includes a processing device (processor)602, a main memory 604 (e.g., read-only memory (ROM), flash memory,dynamic random access memory (DRAM) such as synchronous DRAM (SDRAM)), astatic memory 606 (e.g., flash memory, static random access memory(SRAM)), and a data storage device 616, which communicate with eachother via a bus 608.

Processor 602 represents one or more general-purpose processing devicessuch as a microprocessor, central processing unit, or the like. Moreparticularly, the processor 602 may be a complex instruction setcomputing (CISC) microprocessor, reduced instruction set computing(RISC) microprocessor, very long instruction word (VLIW) microprocessor,or a processor implementing other instruction sets or processorsimplementing a combination of instruction sets. The processor 602 mayalso be one or more special-purpose processing devices such as anapplication specific integrated circuit (ASIC), a field programmablegate array (FPGA), a digital signal processor (DSP), network processor,or the like. The processing logic 215, 315 shown in FIGS. 2A-3B may beexecuted by processor 602 configured to perform the operations and stepsdiscussed herein.

The computer system 600 may further include a network interface device622. The computer system 600 also may include a video display unit 610(e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), analphanumeric input device 612 (e.g., a keyboard), a cursor controldevice 614 (e.g., a mouse), and a signal generation device 620 (e.g., aspeaker).

A drive unit 616 may include a computer-readable medium 624 on which isstored one or more sets of instructions (e.g., instructions of theprocessing logic 215, 315 of FIGS. 2A-3B) embodying any one or more ofthe methodologies or functions described herein. The instructions of theprocessing logic 215, 315 of FIGS. 2A-3B may also reside, completely orat least partially, within the main memory 604 and/or within theprocessor 602 during execution thereof by the computer system 600, themain memory 604 and the processor 602 also constitutingcomputer-readable media. The instructions of the processing logic 215,315 of FIGS. 2A-3B may further be transmitted or received over a network626 via the network interface device 622.

While the computer-readable storage medium 624 is shown in an example tobe a single medium, the term “computer-readable storage medium” shouldbe taken to include a single non-transitory medium or multiplenon-transitory media (e.g., a centralized or distributed database,and/or associated caches and servers) that store the one or more sets ofinstructions. The term “computer-readable storage medium” shall also betaken to include any medium that is capable of storing, encoding orcarrying a set of instructions for execution by the machine and thatcause the machine to perform any one or more of the methodologies of thepresent disclosure. The term “computer-readable storage medium” shallaccordingly be taken to include, but not be limited to, solid-statememories, optical media, and magnetic media.

In the above description, numerous details are set forth. It isapparent, however, to one of ordinary skill in the art having thebenefit of this disclosure, that examples of the disclosure may bepracticed without these specific details. In some instances, well-knownstructures and devices are shown in block diagram form, rather than indetail, in order to avoid obscuring the description.

Some portions of the detailed description are presented in terms ofalgorithms and symbolic representations of operations on data bitswithin a computer memory. These algorithmic descriptions andrepresentations are the means used by those skilled in the dataprocessing arts to most effectively convey the substance of their workto others skilled in the art. An algorithm is here, and generally,conceived to be a self-consistent sequence of steps leading to a desiredresult. The steps are those requiring physical manipulations of physicalquantities. Usually, though not necessarily, these quantities take theform of electrical or magnetic signals capable of being stored,transferred, combined, compared, and otherwise manipulated. It hasproven convenient at times, principally for reasons of common usage, torefer to these signals as bits, values, elements, symbols, characters,terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the above discussion, itis appreciated that throughout the description, discussions utilizingterms such as “receiving”, “writing”, “maintaining”, or the like, referto the actions and processes of a computer system, or similar electroniccomputing device, that manipulates and transforms data represented asphysical (e.g., electronic) quantities within the computer system'sregisters and memories into other data similarly represented as physicalquantities within the computer system memories or registers or othersuch information storage, transmission or display devices.

Examples of the disclosure also relate to an apparatus for performingthe operations herein. This apparatus may be specially constructed forthe required purposes, or it may comprise a general purpose computerselectively activated or reconfigured by a computer program stored inthe computer. Such a computer program may be stored in a computerreadable storage medium, such as, but not limited to, any type of diskincluding floppy disks, optical disks, CD-ROMs, and magnetic-opticaldisks, read-only memories (ROMs), random access memories (RAMs), EPROMs,EEPROMs, magnetic or optical cards, or any type of media suitable forstoring electronic instructions.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general purposesystems may be used with programs in accordance with the teachingsherein, or it may prove convenient to construct a more specializedapparatus to perform the required method steps. Example structure for avariety of these systems appears from the description herein. Inaddition, the present disclosure is not described with reference to anyparticular programming language. It will be appreciated that a varietyof programming languages may be used to implement the teachings of thedisclosure as described herein.

It is to be understood that the above description is intended to beillustrative, and not restrictive. Many other examples will be apparentto those of skill in the art upon reading and understanding the abovedescription. The scope of the disclosure should, therefore, bedetermined with reference to the appended claims, along with the fullscope of equivalents to which such claims are entitled.

What is claimed is:
 1. A method comprising: receiving a primary content data stream associated with an event, wherein the primary content data stream comprises: a primary video content data stream; and a first audio content data stream comprising a primary audio content data stream and a secondary audio content data stream; providing, by a processing device, an alternative content data stream associated with the event; extracting a primary content identifier from the primary content data stream; identifying an alternative content identifier based on the alternative content data stream; synchronizing, by the processing device, the alternative content data stream to the primary content data stream based on the alternative content identifier and the primary content identifier to produce a synchronized alternative content data stream; and transmitting the synchronized alternative content data stream based on the primary content identifier in place of the secondary audio content data stream, wherein the primary content data stream comprises a plurality of primary digital segments and the alternative content data stream comprises a plurality of alternative digital segments, and wherein the primary content identifier is one of a plurality of primary content identifiers comprising a corresponding plurality of digital watermarks or digital fingerprints, wherein the alternative content identifier is one of a plurality of alternative content identifiers comprising a corresponding plurality of digital watermarks or digital fingerprints, and wherein each primary content identifier uniquely identifies a corresponding one of the plurality of primary digital segments and each alternative content identifier uniquely identifies a corresponding one of the plurality of alternative digital segments.
 2. The method of claim 1, wherein transmitting the synchronized alternative content data stream comprises: determining the primary content identifier and the alternative content identifier are equivalent; and permitting transmitting the synchronized alternative content data stream.
 3. The method of claim 1, wherein transmitting the synchronized alternative content data stream comprises: determining the primary content identifier and the alternative content identifier are not equivalent, preventing transmission of the synchronized alternative content data stream.
 4. The method of claim 1, further comprising transmitting the primary content identifier and the alternative content identifier to an end user system.
 5. The method of claim 1, further comprising storing the alternative content identifier and the alternative content data stream in a storage system.
 6. The method of claim 1, further comprising: identifying a second alternative content identifier corresponding to the primary content identifier, wherein the alternative content identifier and the second alternative content identifier are digital watermarks; and transmitting the alternative content identifier and the second alternative content identifier.
 7. The method of claim 1, wherein at least one of the primary content data stream or the alternative content data stream corresponds to one of a video data stream, an audio data stream, or a metadata stream corresponding to the video data stream or the audio data stream.
 8. The method of claim 1, wherein at least one of the secondary content data stream or the alternative content data stream is a color commentary stream, a play-by-play commentary stream, or a sound track.
 9. The method of claim 1, wherein the event comprises at least one of a live or recorded sporting event, a live or recorded entertainment event, a live or recorded video game, or a live or recorded event with a substituted alternative content track.
 10. A system comprising: a memory to store instructions; a processing device, operatively coupled to the memory, the processing device to execute the instructions to: receive a primary content data stream associated with an event, wherein the primary content data stream comprises: a primary video content data stream; and a first audio content data stream comprising a primary audio content data stream and a secondary audio content data stream; provide an alternative content data stream associated with the event; extract a primary content identifier from the primary content data stream; identify an alternative content identifier based on the alternative content data stream; synchronize the alternative content data stream to the primary content data stream based on the alternative content identifier and the primary content identifier to produce a synchronized alternative content data stream; and transmit the synchronized alternative content data stream based on the primary content identifier in place of the secondary audio content data stream, wherein the primary content data stream comprises a plurality of primary digital segments and the alternative content data stream comprises a plurality of alternative digital segments, and wherein the primary content identifier is one of a plurality of primary content identifiers comprising a corresponding plurality of digital watermarks or digital fingerprints, wherein the alternative content identifier is one of a plurality of alternative content identifiers comprising a corresponding plurality of digital watermarks or digital fingerprints, and wherein each primary content identifier uniquely identifies a corresponding one of the plurality of primary digital segments and each alternative content identifier uniquely identifies a corresponding one of the plurality of alternative digital segments.
 11. The system of claim 10, the processing device to: determine the primary content identifier and the alternative content identifier are equivalent; and permit transmitting the synchronized alternative content data stream.
 12. The system of claim 10, the processing device to: determine the primary content identifier and the alternative content identifier are not equivalent, prevent transmission of the synchronized alternative content data stream.
 13. A non-transitory machine-readable storage medium storing instructions that cause a processing device to: receive a direct primary content data stream and a secondary content data stream, both the direct primary content data stream and the secondary content data stream associated with an event, the direct primary content data stream comprising a direct primary content identifier; receive, from an alternative content system, an alternative content data stream corresponding to the event, the alternative content data stream comprising an alternative content identifier and an indirect primary content identifier, the indirect primary content identifier associated with an indirect primary content data stream associated with the event, the indirect primary content identifier and the indirect primary content data stream corresponding to the direct primary content identifier and the direct primary content data stream, respectively, as received by the alternative content system, wherein the alternative content data stream is synchronized to the indirect primary content data stream; extract the direct primary content identifier from the direct primary content data stream; extract the alternative content identifier and the indirect primary content identifier from the alternative content data stream; synchronize the indirect primary content data stream with the alternative content data stream based on the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier, wherein the direct primary content identifier, the indirect primary content identifier, and the alternative content identifier comprise digital watermarks or digital fingerprints; replace the secondary content data stream with the synchronized alternative content data stream; and transmit the synchronized direct primary content data stream and the synchronized alternative content data stream.
 14. The non-transitory computer readable medium of claim 13, the processing device to: receive a second alternative content data stream corresponding to the event; identify a second alternative content identifier based on the second alternative content data stream; synchronize the second alternative content data stream to the primary content data stream based on the second alternative content identifier and the direct primary content identifier, respectively; and transmit the synchronized second alternative content data stream.
 15. The non-transitory computer readable medium of claim 13, wherein the direct primary content identifier uniquely identifies a portion of the primary content data stream, the indirect primary content identifier uniquely identifies a portion of the indirect primary content data stream, and the alternative content identifier uniquely identifies a portion of the alternative content data stream.
 16. The non-transitory computer readable medium of claim 13, wherein at least one of the direct primary content data stream, the indirect primary content data stream, or the alternative content data stream corresponds to one of a video data stream, an audio data stream, or a metadata stream corresponding to the video data stream or the audio data stream.
 17. The non-transitory computer readable medium of claim 13, wherein the alternative content data stream is a second alternative audio commentary stream.
 18. The non-transitory computer readable medium of claim 17, wherein the second alternative audio commentary stream is a color commentary data stream or a play-by-play commentary stream.
 19. The non-transitory computer readable medium of claim 13, wherein the event is a live or recorded sporting event, live or recorded an entertainment event, or a live or recorded video game. 